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CapProbe: An End-to-End Method for Estimating the Narrow Link Capacity 



A) its purpose or utiJity; 



^^tJZ^ f problem in die area of computer network measurements is determining the 
h!?; 7 " ^^'^ ^ non-disruptive and accurate mamier. The capacity of ^ pfth is 

defined as the mimmura physical bandwiddi among all links travereed by a padi. Such a Hnkh^ 

fSTic' fi^^ * ^ rmnimum of the unused capacities among the links of a path. The 
capacity is fixed for a path, whereas the available bandwidth is time varying. Our foots in tMs 
document is on measuring the capacity of a path. varymg. uur tocus m this 

LSI^^ .P~^'**«« '^a" "Pacity estimates to detect either congested or 

™™'?^ °" ^^'"^"^'^ ^^Pa^'ty estii^tes to enhance 

Uieir performance. A clear example of this is in Uie case of TCP Westwood. where various 
bandwidth measures are combined to obtain tighter congestion control. 
While cooperation from Internet routers in measuring tiie capacity could certafaily lead to verv 

oTrA^^'rt^iS'''^^^'*"^^^ would^uL access tHh'e SJal' of 

routers. An end^o-end approach, on die other hand, is expected to be less accurate but is often 

hL^^f^ .^^ I ' . ^"^-'o-^nd capacity estimation approach tiiat is simple, not based on 
heunstics. and extremely accurate across a range of system parameters, «i ™«se« on 

B) the state of the art prior to the Invention; 
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the packet pair at SSer w2 1«I ftl^rtr^'*''' ?f f^'" ^^P^n^'ion of 

cleady coLponftrtiS:;" 1^^*^ .^^^^^ ''l^^f'*- ^"'^^ '^^«'«'^«nt samples 
techniques is that the disteSS «f lile underlying assumption of all these 

unimoL. Le.. tSe samp f S L^^^^ P*^''"* P^''" ^«"P«« 5s 

capacity. ^ ^ maximum frequency of occurrence corresponds to the 

charnriilTa'JaKL*^^^ ""j" '^-tified multi- 

technique to ov^S^S^s^fSulon^^^ '^'^ (PBM)' 

different lengths m^sZlsTto ^^,^^^ 

corresponding to muuKh^ii H„Sl n« r ^'^h multiple modes, treating multiple modes as 

multij^e model ^^^^^1^1 S^'^^n^.f L^^^^^^ '"^''^^ °" '""^ of 

correspond to the caoacitv or a '*°"Sest mode m the multimodal distribution may 

occurs when the netwnrV u '. hL^i ■ -estimate of the capacity. Under^imation 

when the narrowS h foUowJS L'STl?^''^''' over^timation occurs, to various degrees. 
They also observi t£t a rctet^jf?^./^' « Post-Narrov. Links. 

capacity when N-9 ™e ^ consisting of N packets is most useful for estimatinE 

SSaTe i N incS* h ?f J° ' r 'S^'''' ^'S-" cross-traffS Sy 

unimodarxh^ ^^t^ode co™^^^^^ '"^e, the distribution bccom,^ 

for which no physicannTrT,rS'wa? ptS^.h^.'^'^^! (^^>- 
methodology, which first seSs nack^tSrc i^^K- -S^' P««ented a capacity estimation 
with packet ^^ins wi^aL r,^r^^^ multimodal distribution, dien probing 

becomes unimodal ^.d the c^'hv Z Z^^ " T''"^- ^^^"^ '^'^ distributioS 

multimodal distdbuti'tSs rot^i'ir^rpTctet^r '"^"^ """^ ""^^ - 

ro^^idlS'dllaf "^P*^**' P^- rather on the variation of the 

technique. S oS Se geSorof JS^'S T^^^ " P^*=^ l^]. This 

pmbleL/The oveSieaS fSateS ^ti^' l'^ from routers, is known to have scalability 
The capacity of even^ Hnk onTlfh^?« ? f ^"''^ ''"''^ »«> estimate 

anothe^r tJh Jq^S^-oisS Ly £ m °^^f/o ^".'^»^t^«Pafs capacity. Packet tailgartng is 

phase, which meas^SrthVcha^teSI^^ r " u*"^*"^ P*'^^^^ Si^ia 

measures the charaSSstiS of^ch S^n^v?" T"^ P'"'' Tailgating phase, which 

still often inaccuX S^ssSirdul t> ^^^^^ "^P^^^*^ measurements axe 

measurements proceed alSng ^e path ^f errors in capacity estimates as 

C) how it functtons In detail; 

I 

estimated capacit^VuM^s c^o^^Z L^^^^^ °" ''^^r-estimated or an under- 

we develop a JchniqiS SSn7£L^^^ «M<,«^«„fc Exploiting this observation, 

that were 'yistStybVcrssSfit^^^^ '"'"'"^^ '° P^'^'^^^ pair sampled 

accurate over almlst /llTnvir^nSnts e"^^^^^^^^^ "^""^ f'^^^ <=«PP«>«« 

nearly saturates the narrow link irSi»c^ P L mtensiye non-responsive (UDP) traffic that 
as well. ^" '^'^ «" other dispereion-based methods fail 



The Capacity Esmvf ation Problem 



Relying on Packet Pair dispersion to estimate path capacity can actually lead to either under 
Sstonir " °f "P-'^y- We Sow disWthe scenarios wWch S to fuch 

Over-Estimation of Capacity 

Over-estimation occurs when the narrow link is not the last one on the path. i.e.. when so-called 
post narrow Ur^ are present. The presence of these links can reduce the p^cke pair d sptSon 

Sond <foel no?r°* ""^ ""'"^ P''^'"' °' *^ "^'^ ^"^-^ ^ post-narrow Unl wE tS 
second does not (or expenences queuing for a shorter time than the first packet). In th s case the 

d.spers.on between the packet pair is smaller than that created by the narrow nk! Sing to an 
'tZ^TT °^ ^«P«*^'^y- Note that the queueing of the first packet in this case .?ciu!ed by 
mterference from cross-traffic. This behavior, termed "compresston" by previous researclS^ is 

trfficTe""c'S.s" ^'"'"^ ^""""^ cross-traffic packets and as tl^e ^^si! 

Fig 1 shows how capacity can be over-estimated. At the post-narrow link, the dispersion of the 
two packets is reduced since the first packet is queued, but the second one is J^^^"^'"^ 
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Fig I: Over-estimation of Capacity 

n.If!r^? Observation here is that when capacity over-estimation happens, the first packet of the 
packet pair will have queued at a post-narrow link due to interference from cross-traffic. 

Under«Estimation of Capacity 

r.^^^t^l'^tT'''^'' "^""T "1*1^" f ^^"-^^f^'<^ packets are served (transmitted) in between packets 
of the packet pair samples. This mcreases the dispersion of the packet pair and leads to a lower 

SL''i"S^^^^ ' ''"^^ underestimation of cfpacity'ian occ!.r. ItS^u^^^^^^^ 
estimation of capacity is more pronounced as the cross^raffic rate increases, and when the 
underlying expansion of the dispersion is not counter-balanced by compression kfter the nirow 

n^r^wS^fL? '^"''^^'^^^^^^ that when under-estimation occurs, the second packet of the packet 
pair will have queued due to interference from cross-traffic. Note that the second packet can also 

cross-traffic and does not distort the dispersion. 
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Fig 2: Under-estimation of Capacity 



CapProbc 



We present a new capacity estimation technique, which we call CapProbe that is based on the 

^l^^A '"'"ru'* '^^'^y if^^Atmg from cross-traffic) with capacity estimation 

errors as discussed above. CapProbe combines dispersion as well as delay measurements of 
packet pair probes. As we now show, using both dispersion and delay together, one can bo 
beyond existing paclcet pair techniques in providing accurate capacity estimates. 

When packet dispersion under-estimates or over-estimates capacity, at least one packet of the 
packet pair involves cross-traffic induced queueing. Thus, whenever an incorrect value of 
capacuy ,s esumated, the sum of the delays of the packet pair packets includes cross-traffic 
induced queuing delay. 

l^^ifS" Of capacity is estimated, it is not necessary for either 

packet of the packet pair to experience cross-traffic induced queueing delay. Of couise. even 
when dispersion estimates capacity correctly, both packets of the packet pair could be delayed 
due to cross-traffic by the same amount. In this case, dispersion will measure capacity accurately 
but delays of packets will include cross-traffic induced qiwuing delay. accurately. 

If we now make the assumption that at least one sample of the packet pairs goes through 
without cross-traffic interference, we get a sample that measures the correct capc£i^ ;^2Vs 
cflT^T*"* "'[''"T''^'^ The sum of delays of the two packet pair packets for this 

sample will not involve any cross-traffic queumg delay. This sum will, thus, be the minimum 
value for the sum of the delays of the two packets among all packet pair samples. """""""" 

Our techmque. QipProbe. calculates the sum of delays of the two packets for all samples of the 
pactet pau:. The dispersion measured from the sample corresponding to the minimum over all 
delay sums" reflects the narrow link capacity. 

*°"*?u 'II^''*' of Pa*^!'" pair samples, i = 0. 1. 2... Let d, represent the 'delay 
sum , i.e., the sum of the delays of the first and second packets of the packet pair i. Let L be the 
size of the packet pair packets. i»-uouic 

The dispersion T, for a packet pair sample is defined as the difference between the delays of the 
nvo packets of the packet pair sample. We determine the minimum d, for subset of samples, 
having equal value of sample dispersion t^. Let the minimum delay obtained be dk. Thus. 

dk s min {di. for all i such that t| = Tk} 

In Fig 3. we plot dk versus bandwidth estimates. Bk= L/xk. The plot shows that the bandwidth 

^^mT !uT/ *° I*^"""^ •^^P^'^'^y of 4Mbps is obtained at the minimum value of dw 

c^r^^^i-^L'^T r'"f' • ^ «'«>^- No packet pair samples 

corresponding to these bandwidth values were obtained. r »• f 
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Fig 3: Minimum delay sums corresponding to different bandwidth estimates 



intensity varies due to reSt^ve S flor »t ,.f ^i^^ Inteniet in which £c traffic 

of the desired sa™ wTfact we .hL " '^'^ ^^-^ likelihood of cbuining one or more 
found very fewSs thaJ are denrivL of « k°" 'T'^JI^" "''^ experiments later, we 

may not be obSd cLiSnSr^ f ^^^1 '^^^ 

predominant ae. non .43 ^0°^" *=°"eested). ll,P. 

fail anyway. '««««ve> network, m which all packet pa.r measurements techniques will 

D) the best way of practicing the invention; 

T^^^tion could be either dis.ribut«I as a stand-alone tool or included in some bigger 

E) its advantages or improvements over existing practices; 
Simpler, faster, much more accurate than existing schemes. 



L^%trX"coI;tS^^^ '° P^"'"^^ of ISPS (such as 

control algorithm on tte inS? ^ ^"""^^ ""^ "^"^ » «>"8«tion 
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CapProbe: A Simple and Accurate Technique to Measure Path Capacity 
Rohit Kapoor. Ling-Jyh Chen, M. Y. Sanadidi, Mario Gerla 



UCLA, Computer Science 
{rohitk,cclljj,niedy, gerla} @cs.ucla.edu 



^^nZLl^'^^Hn^l^T^L"! Xt^^ "-^[P^ - ""0bm.slve and end-to-end n«nner is a 

dispersion ~^'rbuuS^^^^^^^^ ha- been based on packet 

shown to be inadequate. In this work we extend ri^nfiilfHic^^ t ""^^^ ^'"^^ ^"^ T'^'"** have been 

observation. Our tLuuque. cSlJJSp^te ma^^u?e S n^^^^^^^^^ t of a fumiamental gueuir,s delay 

also the actual delays of the D^ete v^^c^t?. T ^ dispersion between packets of the Packet Pair, but 

very bn>ad range of'^^.^Lt&cSilrj^^^^^^ ^^^^e So' ""'^'r ^ T'^r^^ ' 

traffic is predominantly non-reactive flike UDP^ pl^n where our technique does not work is when the cross- 



1. Introduction 



Accurate knowledge of the capacity of a path is valuable to service providers and usei^ alike While Internet 
service providers can use capacity estimates to detect either congested or unuSiS iTk? aoS^adon! ™nn?no 
'^^Z'TS^^tZSir^^^ " "^^u their Urmance. Alfealt^^J^^^ 

SngestionVonlT ^ ^ ^ ^' ^^^'^ '^"^""^ "^^^^ ^ <=°™bined to obtain tighter 



or trains. In [3], Carter and Crovella proposed bprobe in which fiit^rin<T TT,oti,,>^ro i'^'^*'""^ Pa^Kei pairs 
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sufficently large, the distribution becomes unimodal. The resulting mode corresponds to the so- 
can^ Asymplonc D.spers.on Rate (ADR), for which no physical interpretSion was given. Fmally. they 
disSL^ th!.™h-^''""'r" methodology which first sends packet pairs. If this yields a mulLodal 
disuribu ion. then probing with packet trams with an increasing value of N is initiated. For some value of N, the 
distribution becomes unimodal. and the capacity is selected as the next highest mode after this mode in the 
multimodal distnbution that was obtained from packet pairs. 

A different technique, not based on dispersion of packet pairs, but rather on the variation of the lound-trip 
S Kp » r f was used by Jacobson in pathchar [7]. This technique, based on the generation 

^plies from routers, is known to have scalability problems. The overhead associated with this method 
can be quite high since ,t tries to estimate the capacity of every link on the path in order to estimate the path's 
capacity. Packet tailgaUng is another technique proposed by Lai [8]. This technique is divided into two phases: 
the Sigma phase, which measures the characteristics of the entire patii. and the Tailgating phase, which 
measures the characteristics of each Unk individually. However, the reported measurements L still often 
maccunite. possibly due to accumulaaon of errors in capacity estimates as measurements proceed along the 

Our capacity estimation technique. CapProbe. is based on a simple and fundamental observation.- A packet 
pairmeasuretnent corresponding to either an over-estimated or an under-estimated capacity suffers cross- 
traffic induced queuing tU some link. Exploiting this observation, we develop a technique combining dispersion 
and delay measures to filter out packet pair samples that were "distorted" by cross-traffic. Simulation and 
I^^nn'^rn T^^m I' t°V^' CapProbe accurate over almost all environments, except for intensive non- 
responsive (UDP) traffic that nearly saturates the narrow link. In this last case however, all other dispersion- 
based methods fail as well. 

We describe this idea in more detail in Section 2 and show how it can be used with existing packet pair 
techniques to estimate capacity accurately in a simple, quick and non-disruptive manner. Section 2 also 
describes scenarios under which under- and over-estimation of capacity can occur. Section 3 presents shnulation 
and measurement experiments to study the accuracy of our technique. Section 4 concludes the work and outiines 
future studies in this area. uuuuioa 

2. The Capacity Estimation Problem 

Relying on Packet Pair dispersion to estimate patii capacity can actually lead to either under-estimation or 
over-esumauon of capacity. We now discuss Uie scenarios which lead to such distortion. 

2.1 Over-Estimation of Capacity 

Over-estimation occurs when tiie narrow Unk is not the last one on the path. i.e.. when so^:alled post narrow 
inks are present. The presence of diese links can reduce the packet pair dispersion created by the narrow link if 
the first packet of the pair queues at a post-narrow link, while tiie second does not (or experiences queuing for a 
shorter time than the first packet). In this case, the dispersion between the packet pair is smaller than tiiat (^ated 
by the nanrow link, leading to an over-estimation of capacity. Note tiiat the queueing of tiie first packet in this 
case is caused by interference firom cross-traffic. This behavior, termed "compression" by previous researchers 
IS more pronounced when the probe packets are smaller tiuin cross-traffic packets and as tiie cross-traffic rates 
increase. 



Fig I shows how capacity can be over-estimated. At the post-nairow link, die dispersion of the two packets is 
reduced since the iirsi packet is queued, but Uie second one is not. 
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Fig I: Over-estiauuion cf Capacity 

The key observation h6re is that when capacity over-estimation happens. ihe/Im packet of the packet pair will 
have queued at a post-narrow link due to interference from cross-traffic. 

2J1 Under-Estimation of Capacity 

Under-estinmion occurs when cross-traffic packets are servdd (transmitted) in between packeu of the packet 
pair samples. This increases the dispersion of the packet pair and leads to a lower capacity estimaUon. Fig 2 
shows how under-estimation of capacity can occur. This under-estiroation of capacity is more pronounced as the 
cross-traffic rate increases, and when the underlying expansion of the dispersion is not counter-balanced by 
compression after the narrow link. ^ 

. The key observation here is that when urider-estimation occurs, the second packet of the packet pair will have 
queued due to interference from cross-traffic. Note that the second packet can also experience queuing delay 
due to the first packet. Such delay is different from that induced due to cross-traffic and does not distort the 
dispersion. 
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2: Under-estimation of Capacity 

23 CapProbe 

We present a new capacity esUmation technique, which we call CapProbe that is based on the association of 
increased queuing delay (resulting from cross-traffic) with capacity estimation errors as discussed above. 
CapProbe combines dispersion as well as delay measurements of packet pair probes. As we now show, using 
both dispersion and delay together, one can go beyond existing packet pair techniques in providing accurate 
capacity estimates. -» r o 

When packet dispersion under-esUmaies or over-estimates capacity, at least one packet of the packet pair 
mvo ves cross-traffic induced queueing. Thus, whenever an incorrect value of capacity is estimated, the sum of 
the delays of the packet pair packets includes cross-traffic induced queuing delay. 

On the other hand, when the correct value of capacity is estimated, it is not necessary for either packet of the 
packet pair to experience cross-traffic induced queueing delay. Of course, even when dispersion estimates 
capacity correctly, both packets of the packet pair could be delayed due to cross-traffic by the same amount. In 
this case dispersion will measure capacity accurately, but delays of packets will include cross-traffic induced 
queuing aelay. 
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If we now make the assumption that at least one sample of the packet pairs goes through without cross-traffic 
mterference. we get a sample that measures the correct capacity and does not experience cross-traffic queuing. 

'•^'^y?, °f two packet pair packets for this sample will not involve any cross-traffic queuing 
delay. This sum will, thus, be the nunimum value for the sura of the delays of the two packets among aU packet 
pair samples. 

Our technique. CapProbe^ calculates the sum of delays of the two packets for all samples of the packet pafr.' 
The dispersion measured from the sample corresponding to the minimum over all "delay sums" reflects the 
narrow hnk capacity. 

To illustrate, consider the set of packet pair samples, i = 0, 1. 2... Let d| represent the 'delay sum', i.e., the 
sum of the delays of the first and second packets of the packet pair i. Let L be the size of the packet pair packets. 

The dispersion xj for a packet pair sample is defined as the difference between the delays of the two packets of 
the packet pair sample. We determine the minimum dj for subset of samples, having equal value of sample 
dispersion Xk. Let the minimum delay obtained be d^. Thus. 

dk = min {di, for all i such that Xj = Xk) 

In Fig 3, we plot du versus bandwidth estimates, Bk = U Xk. The plot shows that the bandwidth estimate equal 
to the narrow hnk capacity of 4Mbps is obtained at the minimum value of dk- 

Note that for some bandwidth values, the minimum delay is not shown. No packet pair samples corresponding 
to these bandwidth values were obtained. ^ e r & 
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Fig 3: Minimum elelay sums corresponding to different bandwidth estimates 

CapProbe is based on the assumption that at least one packet pair sample with the appropriate minimum dk is 
r^eived at the destination. In a network such as the Internet in which the traffic intensity varies due to reactive 
TCP flows, there is very high likelihood of obtaining one or more of the desired samples. In fact, as we show in 
our simulation and testbed experimerju later, we found veiy few cases that are deprived of such samples. The 
only cases in which these samples may not be obtained conespond to a highly congested (almost 100% 
'^^Sest"!), UDP-predorainant (i.e., non-reactive) network, in which all packet pair measurements techniques 
will fail anyway. ^ 

3. RESULTS 

In this section, we show results of simulations and measurement experiments to test our scheme. The network 
topology used m our simulations consists of a six-hop path with capacities { 10. 7.5. 5.5, 4. 6 and 8} Mbps. The 
narrow link on the path is 4Mbps. NS-2 [10] was used to perform the simulations. 

The source of the packet pair is at the 10Mbps link and the destination is at the 8Mbps link. The capacity is 
measured at the destination. Note that though we are performing this measurement one-way. the same technique 
could be applied "round-trip". In such a mode, the source sends the packet pair as well as receives the reply and 
performs Oie measurements with a straightforward extension of the method used here. 



4 



I 




t 




(b) 



Fig 4: (a) Persistent traffic (b) Non-persistent traffic 

The cross-traffic on the path can be either persistent (Fig 4 (a)) or non-persistent (Fig 4 (b)). The different 
^affic types we used for the cross-traffic were TCP. UDP and Pareto. The Pareto traffic consisted of 16 Pai^to 
sources with parameter alpha = 1.9 (this is known to result in Long Range Dependent traffic [9]): In each set of 
n™T^ V""* ""T^^.. °^ cross-traffic from 1Mbps to 4Mbps. which is the capacity of the 

hok. Cross-traffic Imks were used to limit the amount of cross-traffic on our test path. The pacL pa£s 

Si hSf ?H f t ^^"^ '"^"^ otl^r^i^. the packet size for the pacLt pair was 

200 bytes. The si mulation time was 30 sec. The size of cross-traffic packets was 500 bytes 

v^LThL^tZ. *^P*^1^^ ^l^^y ^'^'"tics. in particular, the minima of such delays obtained for 
v^ous bandwdth estimates. We also present corresponding bandwidth estimate distributions for same 
scenarios of path and cross-traffic flows. The results reveal the accuracy of CapProbe capacity estimates. 

3.1 Persistent Cross-Traffic 

J. /. / Responsive (TCP) Cross-Traffic 
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cross-traffic 



P^S 5: (a) Minimum delay sums and (b) frequency of occurrence when cross-traffic Is TCP 

Fi^ 5 (a) shows the minimum packet pair delay sums. The index in the figures shows maximum 
rates . Fig 5 (b) shows tfie firequency distribution of bandwidth esUmates from packet dispersion. 

We make the following observations from the graphs: 
> The value of minimum packet pair delay sums is smallest at the point corresponding to the narrow link 

cross-traffic rate is 4Mbps, i.e.. equal to the narrow link 
capacity. CapProbe still works. Thus, when cross-traffic is TCP. our technique measures the right capacity 
even for highly congested links. . . b.... t-apawiy 

^^^K^^" f .'■°'^lf ^' T'** ''"'^''y* " ^Mbps. TWs mode is the Post-Narrow Capacity 
Mode (PNCM) introduced in (61 and represents compression inqiact. 



> 



TCP rates fluctuate, but will be limited by cross-llnk speeds that vary between 1Mbps and 4Mbps. 
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3.7.2 Non-Responsive CBR Cross-Traffic 

We now show simulation results when the cross-traffic is CBR using UDP as transport layer protocol. Fig 6 
(a) shows the nunimum packet pair delay sums. Fig 6 (b) shows the frequency distribution of bandwidth 
estimates from packet dispersion. ^ j uoiiuwxuui 

The UDP cross-traffic results are different from TCP results since UDP is not reactive to congestion. 
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Fig 6: (a) Minimum delay sums and (b) frequency of occurrence when cross-traffic is UDP 

^'^u ^P^°'» predicts the correct capacity UU the UDP cross-traffic is 2Mbps, i.e.. UIl a load of 
50% on the narrow hnk. For higher cross-traffic rates, no samples coiresponding to the correct capacity are 
obtained, bi fact, all samples for cross-traffic of 3Mbps or 4Mbps have a packet dispersion correspondine to 
an estimated bandwidth of 8Mbps. This is basicaUy the PNCM mode described in [6]. 

> It should be noted here that high-rate UDP is a worst^:ase for our technique (and in general, for all packet 
pair-based techniques). Such cross-traffic is also not very realistic. Our basis for experimenting with such 
cross-traffic is to identify cases in which our technique fails. • 

> From Fig 6 (b), the strongest mode corresponds to PNCM at 8Mbps. again resulting from compression. 

3. 1.3 Pareto Traffic 

We now show the results when the cross-traffic is Long Range Dependent, i.e.. consists of 16 Pareto sources, 
that are using UDP as the transport protocol. Fig 7 (a) shows the minimum packet pair delay sums. Fig 7 (b) 
shows the corresponding frequency distribution of bandwidth estimates. 
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P^S 7: (a) Minimum delay sums and (b) frequency of occurrence when cross-traffic is Pareto 



3^ Non-Persistent Cross-Traffic 



3.2. 1 Responsive (TCP) Cross-Traffic 





Fig 8: (a) Mininu,m delay sums and (b) frequency of occurrence when cross is TCP 



capacity for all cross-traffic valu«^ ^IJ^^rU;? r?« CapProbe and the strongest mode yield the correct 

arnc values. As stated earlier, these results are for a packet pair packet size of 200 bytes. 

parkttTir'^^eTars"!"^^^ ~ ^"^Th^ "^.'r^' ' ^^^^^ 

dispersion. ® ^ ^ frequency dtstnbuuon of bandwidth estimates from packet 

is the ADR when J riJJraffit tSps ^ ^«»8«^ ^ 

^ ?S fL'^L^'L^'S^c mXis^lli^^^^ ^^^^'"^-^ — values, 

capacity. strongest mode is the ADR. our CapProbe scheme is able to estimate the correct 

> Note that the smallest value of the minimum packet delay sums has a value of n on^oiA , i. 

traffic rate is 1Mbps. The narrow linlf rt,r^^r.:t^ ^f A\Z - . ® of 0.003214 sec when cross- 

traffic rate is 3Mbps tl^e smaTsrvaW. o^^^^^^^^ ? ''""^"^ estimated in this case. When cross- 

but still the co^c 'caJacTty o?;m^^^^^ 

amount of cross-traffic inducS aueuhiVLIaJ^c ^^^V value includes a small 

sample involving no cSss"SqtSddiTis!Jffi;i ? requirement of obtaining a single packet pair 
estimate the coi^t ca^ ciS^S a Tck^t 1^^^^^^^^^ ^" necessary. While apProbe is certain to 

work even in cases where Kcket Mb SS^^S '"solving no cross-traffic is obtained, it is likely to 
for the 3Mbps crossSc case ^ ^ ^^""^ '^'^ cross-traffic induced queuing delay, as 
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Fig 9: (a) Minumm delay sums aiul(b) frequency of occurrence y^hen cross^traffic is TCP 
Non-Responsive Pareto/CBR Cross-Trqffic 

estimated ?he nLow Sk S^ct^ ^ta" ij '"''"^'^^ cross-trafHc. the CapP«,be techJque 

3.3 Measurement Experiments 

Ihrough a machine runnlnVSunZNetTn wwl^^ 

DummyNet was varied fJm^^tt;^ !^^^^^^^ ^f <^»P»"'y 
would stiU be the narrow link *^ '''P^^'y* ^« if DummyNet 
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Fig 10: Testbed for measurements 



bandwidth dhtributiontisosto>S^^ Al^^^^^^^ -"^^e '^e 

capacity and the actual nanow Sa^cS, T^T^^ percentage) between the estimated 

using CapProbe comparedT:.i';S!:te?Sd'S;^^^^^^^^ ^-'-^o" - "'-'^on errors when 

_DummyNet L ink 
500Kbps 
1Mbps 



5Mbps 
10Mbps 
20Mbps 



CapProbe (kbps 
483,383 (- 3.32 %^ 
941.619 5.84%^ 



4576.659 (- 8.47 %; 
10416.666 (+ 4.17%-^ 
21038.67 5,19 W 



Strongest Mode (kbp s: 
469.07 (> 6. 19 %\ 
860.47 (- 13.95 %^ 
4109.85 (■> 17.80 
7691.32 (-23.09%^ 



17059.03 f- 14.70 %] 



Table I: Results of testbed experiments 
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4. CONCLUSION 



In this work we presented a new technique we call CapProbe to estimate the capacity of an Internet nath This 

onti^cale w"^^^^^^ ' ^'^^ ^^"^^ ^''"^ ^''^ cross-traffic conditions. In fact, the 

^afumes" the ni^^^^^ l^ TZ' T*"''^ cross-traffic is predominantly CBR and n^ly 

saturates the narrow link. In the more prevalent environment of congestion-controlled reactive flow<! n„r 
scheme always works. Compared to a vanilla Packet Pair scheme that selem JSSnTe Jmo^^^^^^^^ 
our scheme .s significantly and consistently more accurate. In fact, the capacity indSfed by the iST^Sf mode 

'^s.7~:'^^^^ ^'"^ - ^-^^^^ (AU^tici^^'iirSoTtS: 

n'Ze, -'"f ; K '''^-^^'^ delay i^ obtained. Obtaining sucTa saZleta ^fy^^ 

^^'c^T:::::'^^^^^ — non-LctTve^rSs! 

Int^rli^ olr' wr^r^K^^ Internet experiments to 'test our scheme in "actual" traffic loads on 

wihTn T?^ f« K i " """""^ applications of CapProbe. One potential application is its use 

moSre u?r ^Z^u^^f'^^^'T 'Tu'' ^PP"^^'^^'^ estimating Uie wireless link ,^paci y of a. 

«S to c .ems " mulUmedia streaming servers to determine appropriate^streLng 
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Capacity Estimation 



» Fundamental Problem: Estinnate minimum 
"physical" capacity in an Internet path 

^ Physical capacity different from available bandwidth 

* Useful to 

♦ Application servers: Multimedia, TCP 

♦ ISPs: Plan capacity upgrades, monitor links 
¥ Estimation should 

^ Work end-to-ehd: assume no help from routers 

♦ Unobtrusive, Quick 



Packet Dispersion 



Previous work mostly based on packet dispersion 
& Packet Dispersion (pairs or trains) 
♦ FIFO routers, no cross-traffic 

Packet Pair 
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t, 



Capacity = (Packet Size) / (Separation = t^) 



Previous Work 

5* Packet Pairs 

❖Crovella: Select highest mode using PP as capacity 
♦Lai: Potential bandwidth filtering 
• Filters some incorrect samples 

oBoth these techniques assume unimodal distribution 

<^Paxson showed distribution can be multimodal 

^ Jacobson's Pathchar 

<^Calculates capacity for every link 

♦Sends packets of various different sizes; tries to 
estimate capacity using delays 

♦Time-consuming and inaccurate 



Previous Work 

^ Dovrolis* Work 

♦ Explained under/over estimation of capacity 

♦ Pathrate 

* First send packet pairs 

• If multimodal, send packet trains 

♦Identifying modes not easy, prone to bin width selection 

♦ Complex 

Still no satisfactory solution ! ! ! 

♦ Most techniques too complicated^ time/bw-consuming^ 
inaccurate and prone to choice of parameters 

♦ Never tested on wireless 
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Problems due to Cross-Traffic 

^ Cross-traffic (CT) serviced between PP packets 
♦ Smaller CT packet size => More likely 
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Cross 
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^ Under-estimation 



Problems (cont) 



Compression of the packet pair 

♦Larger CT packet size => More likely 
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* Over-estimation 



Fundamental Observation 

« Observation (also proved) 

♦When PP dispersion over-estimates capacity 

• First packet of must queue after a bottleneck link 

♦When PP dispersion under-estimates capacity 

• Packets of cross-traffic are serviced between the two PP 
packets 

• Second packet of PP must experience CT induced queuing 
delay 

♦Both expansion and compression of dispersion 
involve queuing 



Observation (cont) 

^ Expansion or Compression 

♦ Sum of delays of PP packets > Minimum sum of delays 
• When Minimum sum of delays? 

♦ Both packets do not suffer CT induced queuing 

* If we can get one sample with no CT induced 
queuing 

♦ Dispersion is not distorted, gives "right" capacity 

♦ Sample can easily be identified since the sum of delays 
is the minimum 



Our Methodology: CapProbe 

^ PP re£illy has two pieces of information 
^ Dispersion of packets 

♦ Delay of packets 

Combines both pieces of inforaiation 

♦ Calculate delay sum for each packet pair sample 

♦ Dispersion at minimum delay sum reflects capacity 




mm 



Capacity 
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Requirements 

* Sufficient but not necessary requirement 

♦ At least one PP sample where both packets 
experience no CT induced queuing delay. 

^ How realistic is this requirement? 

♦ Internet is reactive (mostly TCP): high chance of 
some probe packets not being queued 

^To validate, we performed extensive experiments 

• Simulations and measurements 

• Only cases where such samples are not obtained is 
when cross-traffjc is UDP and very intensive (>75%) 



CapProbe 



* Strength of CapProbe 

♦Only one sample not affected by queuing is 
needed 

* Simplicity of CapProbe 

♦Only 2 values (minimum delay sum and 
dispersion) need storage 

♦One simple comparison operation per sample 

♦Even simplest of earlier schemes (highest mode) 
requires much more storage and processing 



» Simulations, Internet, Intemet2 (Abilene), Wireless 

* TCP (responsive), GBR (non-responsive), LRD 
(Pareto) cross-traffic 

Wireless technologies tested were Bluetooth, IEEE 
802.11, IxRTT 

^ Persistent, non-persistent cross-traffic 



Experiments 





Simulations 



* 6-hop path: capacities { 10, 7.5, 5.5, 4, 6, 8} Mbps 

* PP pkt size = 200 bytes, CT pkt size = 1000 bytes 

* Persistent TCP Cross-Traffic 
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Simulations 



PP pkt size = 500 bytes, CT pkt size = 500 bytes 
« Non-Persistent TCP Cross-Traffic 



Minimum Delay Sums 



0.0063i 



^ 0.0042 -I 
B 

9 

(0 

If 

S 0.0021 



a 1Mbps 
S 3Mbps 



/ 



1^ 



I 



I > I 



1.6 02 4.6 6.4 
Bmdwldm Esifmste (Mbp>) 



6 



• ^ 1 
0.6- 

ao 

0.7 
^ 0.6- 

S o.s< 



0.4 
0.3 
0.2 •{ 
0.1 
0 



Bandwidth Estimate 
Frequency 



a 1Mbps 

Q 3Mbps 



UDder-Estimation 




1.0 3.2 4.8 6.4 

Bandwidth Biltinats (Mbps) 



8 



I 



Simulations 
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« Non-Persistent UDP CBR Cross-Traffic 
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Only case where CapProbe does not work 

» 

^ UDP (non-responsive), extremely intensive 
^ No correct samples are obtained 
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Internet Measurements 
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^ Each experiment 

♦ 500 PP at 0.5s mtervais 

* 100 experiments for each 
{Internet path, nature of CT, 
narrow link capacity) 

^ OS also induces inaccuracy 
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Wireless Measurements 
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^ Experiments for 802.1 lb, 
Bluetooth, IxRTT 

* Clean, noisy channels 

♦ Bad channel retransmission 
'^larger dispersions 'Slower 
estimated capacity 

Results for Bluetooth-interfered 802.11b, TCP cross-traffic 

•http://www.uninett.no/wlan/throughput.htnil : IP throughput 
of 802. 1 lb is around 6Mbps 




Expeiimem No. 


Capacity 
Estimated by 
CapProbe (kbps) 


Capacity Estimated 
by wrongest mode 
(kbps) 
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Probability of Obtaining Sample 



Second Packet 



First Packet 





No Queue 



Link 



NoCrosi 
Traffic Packets 

^ Assuming PP samples arrive in a Poisson manner 
Product of probabilities 
❖No queue in front of first packet; p(0) = 1 - X/}i 

♦ No CT packets enter between the two packets (worst case) 

• Only dependent on arrival process 

^ Analyzed with Poisson Cross-Traffic 

♦ p = p(0) * e-^-^^^ = (1 - TJy) * e-^»* 



Sample Frequency 

^•Average number of Samples required to obtain 
the no-queuing sample 

♦ Analytical 
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♦Poisson cross traffic is a bad case 
"^Bursty Internet traffic has more "windows" 



Sample Frequency 

^ Simulations: mix of TCP, UDP, Pareto cross traffic 
Results for number of samples required 
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^ Internet 

♦ In most experiments, first 20 samples contained the 
minimum delay sample 



Conclusion 

* CapProbe 

^Simple capacity estimation method 

♦ Works accurately across a wide range of scenarios 

^ Only cases where it does not estimate accurately 

• Non-responsive intensive CT 

• This is a failure of the packet dispersion paradigm 

* Useful application 

♦ Use a passive version of CapProbe with "modem" 
TCP versions, such as Westwood 
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